Micron Document
<!DOCTYPE html>
<html class="client-nojs vector-feature-night-mode-disabled vector-feature-language-in-header-enabled vector-feature-language-in-main-page-header-disabled vector-feature-page-tools-pinned-disabled vector-feature-toc-pinned-clientpref-1 vector-feature-main-menu-pinned-disabled vector-feature-limited-width-clientpref-1 vector-feature-limited-width-content-enabled vector-feature-custom-font-size-clientpref-1 vector-feature-appearance-pinned-clientpref-1 vector-sticky-header-enabled" lang="en" dir="ltr"><head>
<meta charset="UTF-8">
<title>Hyperdimensional computing</title>
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<link rel="canonical" href="https://en.wikipedia.org/wiki/Hyperdimensional_computing"> <link href="./mw/ext.cite.styles.css" rel="stylesheet" type="text/css">
<link href="./mw/ext.math.styles.css" rel="stylesheet" type="text/css">
<link href="./mw/skins.vector.icons.css" rel="stylesheet" type="text/css">
<link href="./mw/skins.vector.search.codex.styles.css" rel="stylesheet" type="text/css">
<link href="./mw/skins.vector.styles.css" rel="stylesheet" type="text/css">
<link href="./mw/user.styles.css" rel="stylesheet" type="text/css">
<meta name="ResourceLoaderDynamicStyles" content="">
<link rel="stylesheet" type="text/css" href="./mw/site.styles.css">
<link rel="stylesheet" type="text/css" href="./mw/noscript.css">
<link rel="stylesheet" type="text/css" href="./footer.css">
<link rel="stylesheet" type="text/css" href="./vector-2022.css">
</head>
<body class="skin--responsive skin-vector skin-vector-search-vue mediawiki ltr sitedir-ltr mw-hide-empty-elt ns-0 ns-subject page-Hyperdimensional_computing rootpage-Hyperdimensional_computing skin-vector-2022 action-view">
<div class="mw-page-container">
<div class="mw-page-container-inner">
<div class="mw-content-container">
<main id="content" class="mw-body">
<header class="mw-body-header vector-page-titlebar">
<h1 id="firstHeading" class="firstHeading mw-first-heading">
<span id="openzim-page-title" class="mw-page-title-main"><span class="mw-page-title-main">Hyperdimensional computing</span></span>
</h1>
</header>
<a id="top"></a>
<div id="bodyContent" class="vector-body ve-init-mw-desktopArticleTarget-targetContainer" aria-labelledby="firstHeading" data-mw-ve-target-container="">
<div id="mw-content-text" class="mw-body-content mw-content-ltr" lang="en" dir="ltr"><div class="mw-content-ltr mw-parser-output" lang="en" dir="ltr">
<p><b>Hyperdimensional computing</b> (<b>HDC</b>) is an approach to computation, particularly <a href="Artificial_general_intelligence" title="Artificial general intelligence">Artificial General Intelligence</a>. HDC is motivated by the observation that the <a href="Cerebellum" title="Cerebellum">cerebellum cortex</a> operates on high-dimensional data representations.<sup id="cite_ref-1" class="reference"><a href="#cite_note-1"><span class="cite-bracket">[</span>1<span class="cite-bracket">]</span></a></sup> In HDC, information is thereby represented as a hyperdimensional (long) <a href="Vector_(mathematics_and_physics)" title="Vector (mathematics and physics)">vector</a> called a hypervector. A hyperdimensional vector (hypervector) could include thousands of numbers that represent a point in a space of thousands of dimensions,<sup id="cite_ref-:0_2-0" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup> as vector symbolic architectures is an older name for the same approach. Research extenuates for creating <a href="Artificial_general_intelligence" title="Artificial general intelligence">Artificial General Intelligence</a>.
</p>
<style data-mw-deduplicate="TemplateStyles:r886046785">
/* start https://en.wikipedia.org/ */


.mw-parser-output .toclimit-2 .toclevel-1 ul,.mw-parser-output .toclimit-3 .toclevel-2 ul,.mw-parser-output .toclimit-4 .toclevel-3 ul,.mw-parser-output .toclimit-5 .toclevel-4 ul,.mw-parser-output .toclimit-6 .toclevel-5 ul,.mw-parser-output .toclimit-7 .toclevel-6 ul{display:none}


/* end https://en.wikipedia.org/ */
</style><div class="toclimit-3"><meta property="mw:PageProp/toc"></div>
<div class="mw-heading mw-heading2"><h2 id="Process">Process</h2></div>
<p>Data is mapped from the input space to sparse HD space under an encoding function φ&nbsp;: X → H. HD representations are stored in data structures that are subject to corruption by noise/hardware failures. Noisy/corrupted HD representations can still serve as input for learning, classification, etc. They can also be decoded to recover the input data. H is typically restricted to range-limited integers (-v-v)<sup id="cite_ref-:1_3-0" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p><p>This is analogous to the learning process conducted by <a href="Drosophila" title="Drosophila">fruit flies</a> olfactory system. The input is a roughly 50-dimensional vector corresponding to odor receptor neuron types. The HD representation uses ~2,000-dimensions.<sup id="cite_ref-:1_3-1" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Transparency">Transparency</h2></div>
<p>HDC algebra reveals the logic of how and why systems makes decisions, unlike <a href="Artificial_neural_network" class="mw-redirect" title="Artificial neural network">artificial neural networks</a>. Physical world objects can be mapped to hypervectors, to be processed by the algebra.<sup id="cite_ref-:0_2-1" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Performance">Performance</h2></div>
<p>HDC is suitable for "in-memory computing systems", which compute and hold data on a single chip, avoiding data transfer delays. Analog devices operate at low voltages. They are energy-efficient, but prone to error-generating noise. HDC's can tolerate such errors.<sup id="cite_ref-:0_2-2" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>Various teams have developed low-power HDC hardware accelerators.<sup id="cite_ref-:1_3-2" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p><p>Nanoscale <a href="Memristor" title="Memristor">memristive</a> devices can be exploited to perform computation. An in-memory hyperdimensional computing system can implement operations on two memristive crossbar engines together with peripheral digital <a href="CMOS" title="CMOS">CMOS</a> circuits. Experiments using 760,000 phase-change memory devices performing analog in-memory computing achieved accuracy comparable to software implementations.<sup id="cite_ref-:2_4-0" class="reference"><a href="#cite_note-:2-4"><span class="cite-bracket">[</span>4<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Errors">Errors</h2></div>
<p>HDC is robust to errors such as an individual bit error (a 0 flips to 1 or vice versa) missed by error-correcting mechanisms. Eliminating such error-correcting mechanisms can save up to 25% of compute cost. This is possible because such errors leave the result "close" to the correct vector. Reasoning using vectors is not compromised. HDC is at least 10x more error tolerant than traditional <a href="Artificial_neural_network" class="mw-redirect" title="Artificial neural network">artificial neural networks</a>, which are already orders of magnitude more tolerant than traditional computing.<sup id="cite_ref-:0_2-3" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Example">Example</h2></div>
<p>A simple example considers images containing black circles and white squares. Hypervectors can represent SHAPE and COLOR variables and hold the corresponding values: CIRCLE, SQUARE, BLACK and WHITE. Bound hypervectors can hold the pairs BLACK and CIRCLE, etc.<sup id="cite_ref-:0_2-4" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Orthogonality">Orthogonality</h2></div>
<p>High-dimensional space allows many mutually <a href="Orthogonal" class="mw-redirect" title="Orthogonal">orthogonal</a> vectors. However, If vectors are instead allowed to be <i>nearly orthogonal</i>, the number of distinct vectors in high-dimensional space is vastly larger.<sup id="cite_ref-:0_2-5" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>HDC uses the concept of distributed representations, in which an object/observation is represented by a pattern of values across many dimensions rather than a single constant.<sup id="cite_ref-:1_3-3" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Operations">Operations</h2></div>
<p>HDC can combine hypervectors into new hypervectors using well-defined <a href="Vector_space" title="Vector space">vector space</a> operations.
</p><p><a href="Group_(mathematics)" title="Group (mathematics)">Groups</a>, <a href="Ring_(mathematics)" title="Ring (mathematics)">rings</a>, and <a href="Field_(mathematics)" title="Field (mathematics)">fields</a> over hypervectors become the underlying computing structures with addition, multiplication, permutation, mapping, and inverse as primitive computing operations.<sup id="cite_ref-:2_4-1" class="reference"><a href="#cite_note-:2-4"><span class="cite-bracket">[</span>4<span class="cite-bracket">]</span></a></sup> All computational tasks are performed in high-dimensional space using simple operations like element-wise additions and <a href="Dot_product" title="Dot product">dot products</a>.<sup id="cite_ref-:1_3-4" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p><p>Binding creates ordered point tuples and is also a function ⊗&nbsp;: H × H → H. The input is two points in <var style="padding-right: 1px;">H</var>, while the output is a dissimilar point. Multiplying the SHAPE vector with CIRCLE <i>binds</i> the two, representing the idea “SHAPE is CIRCLE”. This vector is "nearly orthogonal" to SHAPE and CIRCLE. The components are recoverable from the vector (e.g., answer the question "is the shape a circle?").<sup id="cite_ref-:1_3-5" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p><p>Addition creates a vector that combines concepts. For example, adding “SHAPE is CIRCLE” to “COLOR is RED,” creates a vector that represents a red circle.
</p><p>Permutation rearranges the vector elements. For example, permuting a three-dimensional vector with values labeled <i>x</i>, <i>y</i> and <i>z</i>, can interchange <i>x</i> to <i>y</i>, <i>y</i> to <i>z</i>, and <i>z</i> to <i>x</i>. Events represented by hypervectors A and B can be added, forming one vector, but that would sacrifice the event sequence. Combining addition with permutation preserves the order; the event sequence can be retrieved by reversing the operations.
</p><p>Bundling combines a set of elements in H as function ⊕&nbsp;: H ×H → H. The input is two points in H and the output is a third point that is similar to both.<sup id="cite_ref-:1_3-6" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="History">History</h2></div>
<p>Vector symbolic architectures (VSA) provided a systematic approach to high-dimensional symbol representations to support operations such as establishing relationships. Early examples include holographic reduced representations, binary spatter codes, and matrix binding of additive terms. HD computing advanced these models, particularly emphasizing hardware efficiency.<sup id="cite_ref-:1_3-7" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p><p>In 2018, Eric Weiss showed how to fully represent an image as a hypervector. A vector could contain information about all the objects in the image, including properties such as color, position, and size.<sup id="cite_ref-:0_2-6" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>In 2023, Abbas Rahimi et al., used HDC with neural networks to solve <a href="Raven's_Progressive_Matrices" title="Raven's Progressive Matrices">Raven's progressive matrices</a>.<sup id="cite_ref-:0_2-7" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>In 2023, Mike Heddes et Al. under the supervision of Professors Givargis, Nicolau and Veidenbaum created a <a rel="nofollow" class="external text" href="https://torchhd.readthedocs.io/en/stable/index.html#">hyper-dimensional computing library</a><sup id="cite_ref-5" class="reference"><a href="#cite_note-5"><span class="cite-bracket">[</span>5<span class="cite-bracket">]</span></a></sup> that is built on top of <a href="PyTorch" title="PyTorch">PyTorch</a>.
</p>
<div class="mw-heading mw-heading2"><h2 id="Applications">Applications</h2></div>
<div class="mw-heading mw-heading3"><h3 id="Image_recognition">Image recognition</h3></div>
<p>HDC algorithms can replicate tasks long completed by <a href="Deep_neural_networks" class="mw-redirect" title="Deep neural networks">deep neural networks</a>, such as classifying images.<sup id="cite_ref-:0_2-8" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>Classifying an annotated set of handwritten digits uses an algorithm to analyze the features of each image, yielding a hypervector per image. The algorithm then adds the hypervectors for all labeled images of e.g., zero, to create a prototypical hypervector for the concept of zero and repeats this for the other digits.<sup id="cite_ref-:0_2-9" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>Classifying an unlabeled image involves creating a hypervector for it and comparing it to the reference hypervectors. This comparison identifies the digit that the new image most resembles.<sup id="cite_ref-:0_2-10" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>Given labeled example set <span class="mwe-math-element mwe-math-element-inline"><span class="mwe-math-mathml-inline mwe-math-mathml-a11y" style="display: none;"><math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle S=\{(x_{i},y_{i})\}_{i=1}^{N},\ {\scriptstyle {\text{where}}}\ x_{i}\in X\ {\scriptstyle {\text{and}}}\ y_{i}\in \{c_{i}\}_{i=1}^{K}}">
<semantics>
<mrow class="MJX-TeXAtom-ORD">
<mstyle displaystyle="true" scriptlevel="0">
<mi>S</mi>
<mo>=</mo>
<mo fence="false" stretchy="false">{</mo>
<mo stretchy="false">(</mo>
<msub>
<mi>x</mi>
<mrow class="MJX-TeXAtom-ORD">
<mi>i</mi>
</mrow>
</msub>
<mo>,</mo>
<msub>
<mi>y</mi>
<mrow class="MJX-TeXAtom-ORD">
<mi>i</mi>
</mrow>
</msub>
<mo stretchy="false">)</mo>
<msubsup>
<mo fence="false" stretchy="false">}</mo>
<mrow class="MJX-TeXAtom-ORD">
<mi>i</mi>
<mo>=</mo>
<mn>1</mn>
</mrow>
<mrow class="MJX-TeXAtom-ORD">
<mi>N</mi>
</mrow>
</msubsup>
<mo>,</mo>
<mtext>&nbsp;</mtext>
<mrow class="MJX-TeXAtom-ORD">
<mstyle displaystyle="false" scriptlevel="1">
<mrow class="MJX-TeXAtom-ORD">
<mtext>where</mtext>
</mrow>
</mstyle>
</mrow>
<mtext>&nbsp;</mtext>
<msub>
<mi>x</mi>
<mrow class="MJX-TeXAtom-ORD">
<mi>i</mi>
</mrow>
</msub>
<mo>∈<!-- ∈ --></mo>
<mi>X</mi>
<mtext>&nbsp;</mtext>
<mrow class="MJX-TeXAtom-ORD">
<mstyle displaystyle="false" scriptlevel="1">
<mrow class="MJX-TeXAtom-ORD">
<mtext>and</mtext>
</mrow>
</mstyle>
</mrow>
<mtext>&nbsp;</mtext>
<msub>
<mi>y</mi>
<mrow class="MJX-TeXAtom-ORD">
<mi>i</mi>
</mrow>
</msub>
<mo>∈<!-- ∈ --></mo>
<mo fence="false" stretchy="false">{</mo>
<msub>
<mi>c</mi>
<mrow class="MJX-TeXAtom-ORD">
<mi>i</mi>
</mrow>
</msub>
<msubsup>
<mo fence="false" stretchy="false">}</mo>
<mrow class="MJX-TeXAtom-ORD">
<mi>i</mi>
<mo>=</mo>
<mn>1</mn>
</mrow>
<mrow class="MJX-TeXAtom-ORD">
<mi>K</mi>
</mrow>
</msubsup>
</mstyle>
</mrow>
<annotation encoding="application/x-tex">{\displaystyle S=\{(x_{i},y_{i})\}_{i=1}^{N},\ {\scriptstyle {\text{where}}}\ x_{i}\in X\ {\scriptstyle {\text{and}}}\ y_{i}\in \{c_{i}\}_{i=1}^{K}}</annotation>
</semantics>
</math></span><img src="./ccc06e80de476817c136414c8dacadced7a0cf25.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -1.005ex; width:45.707ex; height:3.176ex;" alt="{\displaystyle S=\{(x_{i},y_{i})\}_{i=1}^{N},\ {\scriptstyle {\text{where}}}\ x_{i}\in X\ {\scriptstyle {\text{and}}}\ y_{i}\in \{c_{i}\}_{i=1}^{K}}" loading="lazy"></span> is the class of a particular <i>x<sub>i</sub></i>.<sup id="cite_ref-:1_3-8" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p><p>Given query x<sub>q</sub> ∈ X the most similar prototype can be found with <span class="mwe-math-element mwe-math-element-inline"><span class="mwe-math-mathml-inline mwe-math-mathml-a11y" style="display: none;"><math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle k^{*}=_{k\in 1,...,K}^{argmax}\ p(\phi (x_{q})),\phi (c_{k}))}">
<semantics>
<mrow class="MJX-TeXAtom-ORD">
<mstyle displaystyle="true" scriptlevel="0">
<msup>
<mi>k</mi>
<mrow class="MJX-TeXAtom-ORD">
<mo>∗<!-- ∗ --></mo>
</mrow>
</msup>
<msubsup>
<mo>=</mo>
<mrow class="MJX-TeXAtom-ORD">
<mi>k</mi>
<mo>∈<!-- ∈ --></mo>
<mn>1</mn>
<mo>,</mo>
<mo>.</mo>
<mo>.</mo>
<mo>.</mo>
<mo>,</mo>
<mi>K</mi>
</mrow>
<mrow class="MJX-TeXAtom-ORD">
<mi>a</mi>
<mi>r</mi>
<mi>g</mi>
<mi>m</mi>
<mi>a</mi>
<mi>x</mi>
</mrow>
</msubsup>
<mtext>&nbsp;</mtext>
<mi>p</mi>
<mo stretchy="false">(</mo>
<mi>ϕ<!-- ϕ --></mi>
<mo stretchy="false">(</mo>
<msub>
<mi>x</mi>
<mrow class="MJX-TeXAtom-ORD">
<mi>q</mi>
</mrow>
</msub>
<mo stretchy="false">)</mo>
<mo stretchy="false">)</mo>
<mo>,</mo>
<mi>ϕ<!-- ϕ --></mi>
<mo stretchy="false">(</mo>
<msub>
<mi>c</mi>
<mrow class="MJX-TeXAtom-ORD">
<mi>k</mi>
</mrow>
</msub>
<mo stretchy="false">)</mo>
<mo stretchy="false">)</mo>
</mstyle>
</mrow>
<annotation encoding="application/x-tex">{\displaystyle k^{*}=_{k\in 1,...,K}^{argmax}\ p(\phi (x_{q})),\phi (c_{k}))}</annotation>
</semantics>
</math></span><img src="./ad6d50a9e3e763b52321f7689eea07c35fa54ca9.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -1.338ex; width:28.42ex; height:3.509ex;" alt="{\displaystyle k^{*}=_{k\in 1,...,K}^{argmax}\ p(\phi (x_{q})),\phi (c_{k}))}" loading="lazy"></span>. The similarity metric ρ is typically the dot-product.<sup id="cite_ref-:1_3-9" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading3"><h3 id="Reasoning">Reasoning</h3></div>
<p>Hypervectors can also be used for reasoning. Raven's progressive matrices presents images of objects in a grid. One position in the grid is blank. The test is to choose from candidate images the one that best fits.<sup id="cite_ref-:0_2-11" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>A dictionary of hypervectors represents individual objects. Each hypervector represents an object concept with its attributes. For each test image a neural network generates a binary hypervector (values are +1 or −1) that is as close as possible to some set of dictionary hypervectors. The generated hypervector thus describes all the objects and their attributes in the image.<sup id="cite_ref-:0_2-12" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>Another algorithm creates probability distributions for the number of objects in each image and their characteristics. These probability distributions describe the likely characteristics of both the context and candidate images. They too are transformed into hypervectors, then algebra predicts the most likely candidate image to fill the slot.<sup id="cite_ref-:0_2-13" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p><p>This approach achieved 88% accuracy on one problem set, beating neural network–only solutions that were 61% accurate. For 3-by-3 grids, the system was 250x faster than a method that used <a href="Symbolic_logic" class="mw-redirect" title="Symbolic logic">symbolic logic</a> to reason, because of the size of the associated rulebook.<sup id="cite_ref-:0_2-14" class="reference"><a href="#cite_note-:0-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading3"><h3 id="Other">Other</h3></div>
<p>Other applications include bio-signal processing, natural language processing, and robotics.<sup id="cite_ref-:1_3-10" class="reference"><a href="#cite_note-:1-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="See_also">See also</h2></div>
<ul><li><a href="Support_vector_machine" title="Support vector machine">Support vector machine</a></li></ul>
<div class="mw-heading mw-heading2"><h2 id="References">References</h2></div>
<style data-mw-deduplicate="TemplateStyles:r1239543626">
/* start https://en.wikipedia.org/ */


.mw-parser-output .reflist{margin-bottom:0.5em;list-style-type:decimal}@media screen{.mw-parser-output .reflist{font-size:90%}}.mw-parser-output .reflist .references{font-size:100%;margin-bottom:0;list-style-type:inherit}.mw-parser-output .reflist-columns-2{column-width:30em}.mw-parser-output .reflist-columns-3{column-width:25em}.mw-parser-output .reflist-columns{margin-top:0.3em}.mw-parser-output .reflist-columns ol{margin-top:0}.mw-parser-output .reflist-columns li{page-break-inside:avoid;break-inside:avoid-column}.mw-parser-output .reflist-upper-alpha{list-style-type:upper-alpha}.mw-parser-output .reflist-upper-roman{list-style-type:upper-roman}.mw-parser-output .reflist-lower-alpha{list-style-type:lower-alpha}.mw-parser-output .reflist-lower-greek{list-style-type:lower-greek}.mw-parser-output .reflist-lower-roman{list-style-type:lower-roman}


/* end https://en.wikipedia.org/ */
</style><div class="reflist">
<div class="mw-references-wrap"><ol class="references">
<li id="cite_note-1"><span class="mw-cite-backlink"><b><a href="#cite_ref-1">^</a></b></span> <span class="reference-text"><style data-mw-deduplicate="TemplateStyles:r1238218222">
/* start https://en.wikipedia.org/ */


.mw-parser-output cite.citation{font-style:inherit;word-wrap:break-word}.mw-parser-output .citation q{quotes:"\"""\"""'""'"}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}.mw-parser-output .id-lock-free.id-lock-free a{background:url("./mw/Lock-green.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-limited.id-lock-limited a,.mw-parser-output .id-lock-registration.id-lock-registration a{background:url("./mw/Lock-gray-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-subscription.id-lock-subscription a{background:url("./mw/Lock-red-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .cs1-ws-icon a{background:url("./mw/Wikisource-logo.svg")right 0.1em center/12px no-repeat}body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-free a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-limited a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-registration a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-subscription a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .cs1-ws-icon a{background-size:contain;padding:0 1em 0 0}.mw-parser-output .cs1-code{color:inherit;background:inherit;border:none;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;color:var(--color-error,#d33)}.mw-parser-output .cs1-visible-error{color:var(--color-error,#d33)}.mw-parser-output .cs1-maint{display:none;color:#085;margin-left:0.3em}.mw-parser-output .cs1-kern-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right{padding-right:0.2em}.mw-parser-output .citation .mw-selflink{font-weight:inherit}@media screen{.mw-parser-output .cs1-format{font-size:95%}html.skin-theme-clientpref-night .mw-parser-output .cs1-maint{color:#18911f}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .cs1-maint{color:#18911f}}


/* end https://en.wikipedia.org/ */
</style><cite id="CITEREFZouAlimohamadiImaniKim2021" class="citation cs2">Zou, Zhuowen; Alimohamadi, Haleh; Imani, Farhad; Kim, Yeseong; Imani, Mohsen (2021-10-01), <i>Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework</i>, <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/2110.00214">2110.00214</a></span></cite></span>
</li>
<li id="cite_note-:0-2"><span class="mw-cite-backlink">^ <a href="#cite_ref-:0_2-0"><sup><i><b>a</b></i></sup></a> <a href="#cite_ref-:0_2-1"><sup><i><b>b</b></i></sup></a> <a href="#cite_ref-:0_2-2"><sup><i><b>c</b></i></sup></a> <a href="#cite_ref-:0_2-3"><sup><i><b>d</b></i></sup></a> <a href="#cite_ref-:0_2-4"><sup><i><b>e</b></i></sup></a> <a href="#cite_ref-:0_2-5"><sup><i><b>f</b></i></sup></a> <a href="#cite_ref-:0_2-6"><sup><i><b>g</b></i></sup></a> <a href="#cite_ref-:0_2-7"><sup><i><b>h</b></i></sup></a> <a href="#cite_ref-:0_2-8"><sup><i><b>i</b></i></sup></a> <a href="#cite_ref-:0_2-9"><sup><i><b>j</b></i></sup></a> <a href="#cite_ref-:0_2-10"><sup><i><b>k</b></i></sup></a> <a href="#cite_ref-:0_2-11"><sup><i><b>l</b></i></sup></a> <a href="#cite_ref-:0_2-12"><sup><i><b>m</b></i></sup></a> <a href="#cite_ref-:0_2-13"><sup><i><b>n</b></i></sup></a> <a href="#cite_ref-:0_2-14"><sup><i><b>o</b></i></sup></a></span> <span class="reference-text"><cite id="CITEREFAnanthaswamy2023" class="citation web cs1">Ananthaswamy, Anan (April 13, 2023). <a rel="nofollow" class="external text" href="https://www.quantamagazine.org/a-new-approach-to-computation-reimagines-artificial-intelligence-20230413/?mc_cid=ad9a93c472&amp;mc_eid=506130a407">"A New Approach to Computation Reimagines Artificial Intelligence"</a>. <i>Quanta Magazine</i>.</cite></span>
</li>
<li id="cite_note-:1-3"><span class="mw-cite-backlink">^ <a href="#cite_ref-:1_3-0"><sup><i><b>a</b></i></sup></a> <a href="#cite_ref-:1_3-1"><sup><i><b>b</b></i></sup></a> <a href="#cite_ref-:1_3-2"><sup><i><b>c</b></i></sup></a> <a href="#cite_ref-:1_3-3"><sup><i><b>d</b></i></sup></a> <a href="#cite_ref-:1_3-4"><sup><i><b>e</b></i></sup></a> <a href="#cite_ref-:1_3-5"><sup><i><b>f</b></i></sup></a> <a href="#cite_ref-:1_3-6"><sup><i><b>g</b></i></sup></a> <a href="#cite_ref-:1_3-7"><sup><i><b>h</b></i></sup></a> <a href="#cite_ref-:1_3-8"><sup><i><b>i</b></i></sup></a> <a href="#cite_ref-:1_3-9"><sup><i><b>j</b></i></sup></a> <a href="#cite_ref-:1_3-10"><sup><i><b>k</b></i></sup></a></span> <span class="reference-text"><cite id="CITEREFThomasDasguptaRosing2021" class="citation journal cs1">Thomas, Anthony; Dasgupta, Sanjoy; Rosing, Tajana (2021-10-05). <a rel="nofollow" class="external text" href="https://redwood.berkeley.edu/wp-content/uploads/2021/08/Thomas2021.pdf">"A Theoretical Perspective on Hyperdimensional Computing"</a> <span class="cs1-format">(PDF)</span>. <i>Journal of Artificial Intelligence Research</i>. <b>72</b>: <span class="nowrap">215–</span>249. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1613%2Fjair.1.12664">10.1613/jair.1.12664</a>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a>&nbsp;<a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/1076-9757">1076-9757</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a>&nbsp;<a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:239007517">239007517</a>.</cite></span>
</li>
<li id="cite_note-:2-4"><span class="mw-cite-backlink">^ <a href="#cite_ref-:2_4-0"><sup><i><b>a</b></i></sup></a> <a href="#cite_ref-:2_4-1"><sup><i><b>b</b></i></sup></a></span> <span class="reference-text"><cite id="CITEREFKarunaratneLe_GalloCherubiniBenini2020" class="citation journal cs1">Karunaratne, Geethan; Le Gallo, Manuel; Cherubini, Giovanni; Benini, Luca; Rahimi, Abbas; Sebastian, Abu (June 2020). <a rel="nofollow" class="external text" href="https://www.nature.com/articles/s41928-020-0410-3">"In-memory hyperdimensional computing"</a>. <i>Nature Electronics</i>. <b>3</b> (6): <span class="nowrap">327–</span>337. <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/1906.01548">1906.01548</a></span>. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1038%2Fs41928-020-0410-3">10.1038/s41928-020-0410-3</a>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a>&nbsp;<a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/2520-1131">2520-1131</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a>&nbsp;<a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:174797921">174797921</a>.</cite></span>
</li>
<li id="cite_note-5"><span class="mw-cite-backlink"><b><a href="#cite_ref-5">^</a></b></span> <span class="reference-text"><cite id="CITEREFHeddesNunesVergésKleyko2022" class="citation arxiv cs1">Heddes, Mike; Nunes, Igor; Vergés, Pere; Kleyko, Denis; Abraham, Danny; Givargis, Tony; Nicolau, Alexandru; Veidenbaum, Alexander (2022-05-18). "Torchhd: An Open Source Python Library to Support Research on Hyperdimensional Computing and Vector Symbolic Architectures". <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/2205.09208">2205.09208</a></span> [<a rel="nofollow" class="external text" href="https://arxiv.org/archive/cs.LG">cs.LG</a>].</cite></span>
</li>
</ol></div></div>
<ul><li><cite id="CITEREFKleykoRachkovskijOsipovRahimi2023" class="citation journal cs1">Kleyko, Denis; Rachkovskij, Dmitri A.; Osipov, Evgeny; Rahimi, Abbas (2023-07-31). <a rel="nofollow" class="external text" href="https://dl.acm.org/doi/10.1145/3538531">"A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations"</a>. <i>ACM Computing Surveys</i>. <b>55</b> (6): <span class="nowrap">1–</span>40. <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/2111.06077">2111.06077</a></span>. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1145%2F3538531">10.1145/3538531</a>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a>&nbsp;<a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/0360-0300">0360-0300</a>.</cite></li>
<li><cite id="CITEREFKleykoRachkovskijOsipovRahimi2023" class="citation journal cs1">Kleyko, Denis; Rachkovskij, Dmitri; Osipov, Evgeny; Rahimi, Abbas (2023-09-30). <a rel="nofollow" class="external text" href="https://dl.acm.org/doi/10.1145/3558000">"A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part II: Applications, Cognitive Models, and Challenges"</a>. <i>ACM Computing Surveys</i>. <b>55</b> (9): <span class="nowrap">1–</span>52. <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/2112.15424">2112.15424</a></span>. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1145%2F3558000">10.1145/3558000</a>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a>&nbsp;<a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/0360-0300">0360-0300</a>.</cite></li></ul>
<div class="mw-heading mw-heading2"><h2 id="External_links">External links</h2></div>
<ul><li><cite id="CITEREFStock,_M.Van_Criekinge,_W.Boeckaerts,_D.Taelman,_S.2024" class="citation cs2 cs1-prop-vanc-accept">Stock, M., Van Criekinge, W., Boeckaerts, D., Taelman, S., Van Haeverbeke, M., Dewulf, P., De Baets, B. (2024), Dutt, V. (ed.), "Hyperdimensional computing: a fast, robust, and interpretable paradigm for biological data", <i>PLOS Computational Biology</i>, <b>20</b> (9), Public Library of Science (PLOS): e1012426, <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/2402.17572">2402.17572</a></span>, <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://doi.org/10.1371%2Fjournal.pcbi.1012426">10.1371/journal.pcbi.1012426</a></span>, <a href="PMID_(identifier)" class="mw-redirect" title="PMID (identifier)">PMID</a>&nbsp;<a rel="nofollow" class="external text" href="https://pubmed.ncbi.nlm.nih.gov/39316621">39316621</a></cite></li></ul>
<ul><li><cite id="CITEREFCumbo,_F.Chicco,_D.2025" class="citation cs2 cs1-prop-vanc-accept">Cumbo, F., Chicco, D. (2025), "Hyperdimensional computing in biomedical sciences: a brief review", <i>PeerJ Computer Science</i>, <b>11</b> (e2885): e2885, <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://doi.org/10.7717%2Fpeerj-cs.2885">10.7717/peerj-cs.2885</a></span>, <a href="PMC_(identifier)" class="mw-redirect" title="PMC (identifier)">PMC</a>&nbsp;<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12192801">12192801</a></span></cite></li></ul>
<ul><li><cite id="CITEREFKanerva2009" class="citation journal cs1">Kanerva, Pentti (2009-06-01). <span class="id-lock-subscription" title="Paid subscription required"><a rel="nofollow" class="external text" href="https://doi.org/10.1007/s12559-009-9009-8">"Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random Vectors"</a></span>. <i>Cognitive Computation</i>. <b>1</b> (2): <span class="nowrap">139–</span>159. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2Fs12559-009-9009-8">10.1007/s12559-009-9009-8</a>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a>&nbsp;<a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/1866-9964">1866-9964</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a>&nbsp;<a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:733980">733980</a>.</cite></li></ul>
<ul><li><cite id="CITEREFNeubertSchubertProtzel2019" class="citation journal cs1">Neubert, Peer; Schubert, Stefan; Protzel, Peter (2019-12-01). <span class="id-lock-subscription" title="Paid subscription required"><a rel="nofollow" class="external text" href="https://doi.org/10.1007/s13218-019-00623-z">"An Introduction to Hyperdimensional Computing for Robotics"</a></span>. <i>KI – Künstliche Intelligenz</i>. <b>33</b> (4): <span class="nowrap">319–</span>330. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2Fs13218-019-00623-z">10.1007/s13218-019-00623-z</a>. <a href="ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a>&nbsp;<a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/1610-1987">1610-1987</a>. <a href="S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a>&nbsp;<a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:202642163">202642163</a>.</cite></li></ul>
<ul><li><cite id="CITEREFNeubertSchubert2021" class="citation arxiv cs1">Neubert, Peer; Schubert, Stefan (2021-01-19). "Hyperdimensional computing as a framework for systematic aggregation of image descriptors". <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/2101.07720v1">2101.07720v1</a></span> [<a rel="nofollow" class="external text" href="https://arxiv.org/archive/cs.CV">cs.CV</a>].</cite></li></ul>
<ul><li><cite id="CITEREFStock2022" class="citation web cs1">Stock, Michiel (2022-10-04). <a rel="nofollow" class="external text" href="https://michielstock.github.io/posts/2022/2022-10-04-HDVtutorial/">"Tutorial on Hyperdimensional Computing"</a><span class="reference-accessdate">. Retrieved <span class="nowrap">2023-07-29</span></span>.</cite></li></ul>
<ul><li><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://www.hd-computing.com/">"HD/VSA"</a>. <i>www.hd-computing.com</i>. 2023-03-13<span class="reference-accessdate">. Retrieved <span class="nowrap">2023-04-15</span></span>.</cite></li></ul>
<ul><li><cite id="CITEREFAnanthaswamy2023" class="citation magazine cs1">Ananthaswamy, Anil (2023-04-13). <a rel="nofollow" class="external text" href="https://www.quantamagazine.org/a-new-approach-to-computation-reimagines-artificial-intelligence-20230413/">"A New Approach to Computation Reimagines Artificial Intelligence"</a>. <i>Quanta Magazine</i><span class="reference-accessdate">. Retrieved <span class="nowrap">2023-06-13</span></span>.</cite></li></ul></div><!--htdig_noindex--><div><div class="zim-footer">
This article is issued from <a class="external text" title="Last edited on 2025-07-20" href="https://en.wikipedia.org/wiki/?title=Hyperdimensional_computing&amp;oldid=1301524927">Wikipedia</a>. The text is available under <a class="external text" href="https://creativecommons.org/licenses/by-sa/4.0/deed.en">Creative Commons Attribution-Share Alike 4.0</a> unless otherwise noted. Additional terms may apply for the media files.
</div>
</div><!--/htdig_noindex--></div>
</div>
</main>
</div>
</div>
</div>

</body></html>